3D Motion Estimation using Expansion Matching and KL based Canonical Images

This paper describes a novel approach to 3D motion estimation of planar objects based on eigen-normalization, Expansion Matching (EXM) and a scaled orthographic projection model. Our approach leads to a comprehensive temporal description of all degrees of freedom in 3D (3 rotations and 3 translations). The 3D motion parameters of the objects are approximated by the corresponding aane parameters. The objects in each frame of a video sequence are normalized to a set of canonical images using principal component normalization procedure. The normaliza-tion approach here is based on principal components of the intensity weighted spatial values and not on the intensity values as in works such as eigenfaces. The canonical images generated diier only in orientation. Expansion Matching (EXM) is then used to nd the diierences in orientation. AAne transformations between the shapes also are derived. The pose of the shape in 3D space can therefore be estimated. Experiments on video sequences of planar and quasi-planar objects show robust estimation of the real 3D rotations and translations of the objects in motion.